Although batteries move electrons through a voltage, the batteries themselves have an associated internal resistance resulting from the materials from which the batteries are constructed. Thus the voltage supplied by the battery is actually decreased by the internal resistance:
In most cases, the loss of voltage due to internal resistance is small enough to be neglected.